Multi-depth Camera System for 3d Video Generation

In this paper, we describe a multi-depth camera system for 3D video contents generation. We combine five video cameras and five TOF depth cameras to capture a scene in real time. By taking advantages of both active and passive sensor based depth acquisition methods, we can estimate multi-view depth sequences accurately. After performing several steps of preprocessing, the depth sequences are warped to the corresponding video camera positions and used as initial depth values for refinement. By applying the stereo matching method, we can improve multi-view depth sequences. Intermediate view image sequences are then synthesized using both the multi-view color and depth sequences.